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Abstract 

A method for constructing Boolean-valued models of some fragments 
of arithmetic was developed in [3J, with the intended applications in 
bounded arithmetic and proof complexity. Such a model is formed by 
a family of random variables defined on a pseudo-finite sample space. We 
show that under a fairly natural condition on the family (called com- 
pactness in [3j) the resulting structure has a property that is naturally 
interpreted as saturation for existential types. We also give an example 
showing that this cannot be extended to universal types. 

Let K be a Boolean-valued L-structure. That is, each sentence A in the 
language L(K), L augmented by constants for all elements of K, is assigned a 
truth-value JAJ in a complete Boolean algebra B. These values commute with 
prepositional connectives (after BoolepQ) and satisfy 

l3xA(x)j = \/lA(u)} and JVxA(x)] = f\ {A(u)} 

uGK ueK 

(after Rasiowa-Sikorski[5]). 

Let p be a set of formulas in variables x = x%, . . . , x n . In the classical case 
the set p is an n-type over a structure if it is finitely satisfied, i.e. 

A 3x A A ^ 
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where $ runs over finite subsets of p, and it is realized in the structure if 

3x f\ A(x) 
Aep 

holds there. In the context of Boolean-valued structures this is naturally tran- 
scribed as the following condition on truth values: 

(Satur) f\ I3x f\ A(z)J < f\ {A(u)} 

for some u £ K n ; we shall say that such u realizes (Satur) for p in the 
structure. Note that in that case (Satur) is actually an equality as the left-hand 
side always majorizes the right-hand side. 

In this paper we show that a certain class of Boolean- valued structures con- 
structed via forcing with random variables (recalled in Sections [1] and [2]) is 
saturated in this sense for sets of existential formulas. This is done first for 
the special case of sets p consisting of open formulas in Section [3J to display 
clearly the idea, and for the existential case in Section 2J In Section [5] we give 
an example of a structure from the same class that is not saturated for sets of 
universal formulas. The paper is concluded by a brief explanation in Section [6] 
how is open saturation of the structures considered potentially relevant to proof 
complexity. 

Background on model theory can be found in 4 , further material (and 
details) on forcing with random variables in [3J . 

1 Forcing with random variables set-up 

In this section we shall briefly recall the construction of Boolean valued struc- 
tures by forcing with random variables from [3J . The intended target structures 
are models of arithmetic with a special emphasis on bounded arithmetic. This 
is motivated by a close relation of bounded arithmetic to proof complexity but 
we shall not review this topic here (an interested reader can consult 013]). 

The structures are built from a family of random variables on a pseudo-finite 
sample space. Let M. be a non-standard Ni-saturated model of true arithmetic 
in some language L containing the language of Peano arithmetic and having a 
canonical interpretation in the standard model N. In [3J we took a language 
having symbols for all relations and functions on N but here it is natural to 
consider countable L. In fact, we shall assume that L is definable in Peano 
arithmetic (this includes finite and recursive languages). 

Let SI G M be an infinite set; as it is an element of the model it is .M-finite. 
Let F C X be any family of functions a : Q — > M., We call elements of F 
random variables. It is not assumed that F is definable in the ambient model 
M. 

Let A be the Boolean algebra of .M-definable subsets of f2 and let B be its 
quotient by the ideal I of sets of an infinitesimal counting measure. Using the 
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idea of Loeb's measure, the Ki-saturation of M. and some measure theory it was 
shown in [5J that B is a complete Boolean algebra. 

The counting measure on A induces a strict measure [i (in the ordinary 
sense with values in R) on B. The measure defines a metric on B: the distance 
of two elements is the measure of their symmetric difference. 

For any fc-ary function symbol / from L and any ax, ■ ■ ■ , otk € F define the 
function f(a\, . . . , at) '■ f2 — > M by 

f(otx,...,ak)(u>) ■= f(ax(u),-..,a k (u)), for w e O . 

If this function is also always in F we say that F is L- closed. 

Any L-closed family F is the universe of a Boolean- valued L-structure K(F) 
with L(F)-sentences having their truth values in B defined as follows. Every 
atomic L(F)-sentence A is naturally assigned a set ((A)) from A consisting of 
those samples u E il for which A is true in M. The image of ((A)) in B, 
the quotient ((A)) /I, is denoted \A\. Following Boole [1] and Rasiowa-Sikorski 
[5] this determines the truth value \A\ £ B for any L(F)-sentence A: [. . .] 
commutes with Boolean connectives and 

l3xA(x)i := \/ lA(a)] and frfxA{x)} := A l A (<*)l ■ 

aeF aeF 

It holds that all logically valid sentences get the maximal truth value 1b- We 
say that a sentence is valid in A4 if its truth value is lg. 

There are various generalizations of this basic set-up considered in [3]. For 
example, the random variables from the family F can be only partially defined 
on the sample space f2 (as long as their regions of undefinability have infinitesi- 
mal counting measures) or the sample space may be equipped with some other 
probability distribution than the uniform one. 

We shall use one immediate consequence of the Hi-saturation of M. and so 
we formulate it as a lemma. 

Lemma 1.1 Let {oJigN be any sequence of elements of M.. Then there is 
an element a* S M. that codes a sequence {a*}i<t of some non-standard length 
t e M \ N such that a* k = a k for all k G N. 

Any such element a* is called a non-standard extension of {a^}fe e N- We 
shall skip in future the * in the notation and denote a non-standard extension 
simply as {«i}i<t- 

2 Compact families and witnessing of quanti- 
fiers 

In this section we shall recall the concept of a compact family F from [3j Chpt.3] 
and some properties of K(F) it implies. 

Definition 2.1 Let F C M. be a family. 
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1. F is closed under definitions by cases by open L-formulas iff when- 
ever a, /3 £ F and B(x) is an open L{F) -formula with free variable x then 
there is 7 G F such that: 

, . J a{uS) if B(a(ui)) holds 
1 ftw) otherwise. 

2. F is compact iff there exists an L-formula H(x,y) such that for 

F a :={beM \ M^H{a 7 b)} 
the following two properties hold: 

• F k D F k+1 , for all k e N. 

Recall that the Overspill is the principle, a simple consequence of induction, that 
if a property definable in A4 holds for all standard numbers, it must hold actually 
for all elements up to some non-standard element of M (cf. S\ Appendix]). 
The primary intended use of compact families is to allow the following type of 
reasoning. 

Assume {a k } k £N is an arbitrary sequence of elements of F and that {«i}i<t 
is its non-standard extension. Note that the conditions posed on sets Ft in the 
definition of compactness imply that for all standard k it holds that 

• Vj < k otj £ Fk, and 

• Vj< k Fj D F J+1 . 

By the Overspill in M. this must hold also for some non-standard s < t. In 
particular, all ctj from the non-standard extension with j < s are in F s C F, 
and hence in F too. 

Theorem 2.2 /«?, Thm.3.5.2] 

Let F be an L-closed family that is closed under definition by cases by open 
L-formulas and compact. Let A be an L(F)- sentence of the form 

3xiVyi . . . 3x k Vy k B(xi,yi, ...,x k ,yk) 

with B open. 

Then there are oti,j3i,..., a k , Pk £ F such that for all i — 1, . . . , k: 

[Vyi3x i+ iVy i+ i . . . 3x k \/y k B(ai, ft, . . . , on, y i: x i+1 ,y t+1 , ...,x k , y k )j = (Aj 
and 

pa; i+ iVy i+ i . . . 3x k My k B(a 1 , ft, . . . , en, ft, x l+1 ,y i+1 , ...,x k , y k )j = lAj . 
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3 Saturation for sets of open formulas 



In this section we prove a special case of saturation when all formulas in the 
set p are open. We will use the following immediate corollary of Theorem 12.21 
To simplify the notation we consider, here as well as in the next section, sets of 
formulas in one free variable; the general case would be done in the same way. 

Corollary 3.1 Let F be an L-closed family that is closed under definition by 
cases by open L-formulas and compact. Let A(x) be an open L(F)-formula with 
one free variable x. 

Then there is a £ F such that: 

13xA(x)} = lA(a)j = ((A(a)))/1 . 

Proof : 

The first equality follows from Theorem 12.21 and the second one follows by 
the definition of fAJ as A is open and taking the quotient by I commutes with 
Boolean connectives. 

q.e.d. 

In proving the next theorem we could restrict to the special case when the 
left-hand side of (Satur) has value lg by taking a suitable quotient of B. How- 
ever, this would be done at the expense of having to show that the inequality for 
the resulting new Boolean- valued structure could be pulled back to the original 
one. We thus prefer not to make this simplification. 

Theorem 3.2 Let L be a language definable in Peano arithmetic. Let F be an 
L-closed family that is closed under definition by cases by open L-formulas and 
compact. 

Assume that p is a countable set of open L{F) -formulas in one free variable 

x. 

Then there is an element a £ F that realizes the saturation inequality (Satur) 
for the set p in K(F). 

Proof : 

Let A'i(x),A' 2 (x), . . . enumerate p and define 

A k {x) := /\ A! i (x) , for k > 1 . 

i<k 

Then we have the following 
Claim l:All implications 

A k+1 (x) ->■ A k (x) 

are logically valid and if an element a £ F satisfies the following inequality 

/\l3xA k (x)i < /\lA k (a)i 

k fc 
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then a realizes the (Satur) inequality for p in K(F). 

Note that the inequality is actually an equality in that case. 

Claim 2: Assume a € F, U C SI AU e M and it holds 

((Ak(a))) D U 

for all k eN, and 

A*(pxA fc (aO]) \ n{U/X) 

as standard k — > oo. 

Then a satisfies the inequality from Claim 1 and hence realizes (Satur,) for 
p in K(F). 

The arrow \ means that the sequences of reals on the left-hand side is non- 
increasing and its limit is the right-hand side. The claim follows as 

l3xA k {x)\) > IM<*)D > U/X. 

Now we are going to show that some a and U satisfying the hypothesis of 
Claim 2 do exist. This will prove the theorem. 
By Corollary 13.11 there are at £ F such that 

l3xA k (x)} = lA k (a k )j . 

Define U k ■= ((A k (a k ))), so 

l3xA k (x)j = U k /Z 
and as Ag logically implies A k for / > k, also 

Uk 3 Ut , for I > k . 

Consider the sequence {A k , a k , U k } k ^Tsi and let 

{Ai, c*i, Ui}i< t , t non-standard 

be its non-standard extension provided by Lemma 12.11 

By the compactness of F there is a definable family {F a } a of sets such that 
F = f] k eN F k . Consider the following property, definable in M. (the definability 
of L is used here), of an element i < t. It is the conjunction of seven conditions: 

1. Ai is an open L(i 7 i)-formula. 

2. Ai — > Aj is logically valid for all j <i. 

3. ((M<*i)» = u >- 

4. ft 2 Ui D . . . 2 Ui. 
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5 - W - W < for all j < i. 

6. Fj D ... DFi. 

7. a j 6 Fj for all j < i 

All seven conditions are valid for all standard i perhaps with the exception of 
5: but taking a suitable subsequence of the original sequence {A k , otk, Uk}keisi 
arranges this condition too. The first two items are included because in the 
argument below we need to talk in M. also about the satisfiability relation for 
formulas Ai with a non-standard index. By the Overspill then the property 
must be true for all i < s up to some non-standard s < t. We want to show 
that for such an s, a s and U s satisfy the hypothesis of Claim 2. 

By 6 and 7 a s 6 F s C F and by 1, 2 and 3 

((A k (a s ))) D ((A s (a s ))) = U s 
for all k £ N. It remains to note that 

follows by 3, 4 and 5. 

q.e.d. 

In the argument we have used that for an open formula A(x) the set ((A(a))) 
is definable from a and satisfies = ((A(a))) /X. This is not true for general 

formulas but for for existential formulas one could add witnesses (in the sense 
of Corollary 13. ip for the values [Afc(afc)J to the data in {Ak, at, Uk}k£f< and 
run an analogous argument. 

Assuming little bit more about the structure however, we can derive the 
existential case directly from Theorem 13.21 

4 The existential case 

In this section we note that Theorem 13.21 implies the statement also for sets 
of existential formulas as long as the underlying structure admits a pairing 
function. This is always the case for structures of interest in [3] as they are 
models of various bounded arithmetics. 

Definition 4.1 Let F be an L- closed family. We say that K(F) has pairing 
if L contains symbols tti (x) , 7T2 (x) for two unary functions and a symbol (x,y) 
for a binary function, and the universal closures of the following three formulas 
are valid in K(F): 

• (7ri(z),7r 2 (z)) = z. 

• ni((x,y)) = x. 
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• n 2 ((x,y)) = y. 



Theorem 4.2 Let L be a language definable in Peano arithmetic. Let F be an 
L- closed family that is closed under definition by cases by open L-formulas and 
compact. Assume that K(F) has pairing. 

Let p be a countable set of existential L(F) -formulas in one free variable x. 
Then there is an element a G F that realizes the saturation inequality (Satur) 
for the set p in K(F). 

Proof : 

Using the pairing to replace several existential quantifiers by one we may 
assume without a loss of generality that the formulas in p have the form A(x) = 
3yB(x, y), with B open. Enumerate p as Ak(x) = 3yBk(x, y), k G N, and define 
open formulas 

C k (z) := ^( 7 r 1 (z)^ 1 (4 fe) (z))) 

(k) 

where ir^ abbreviates fc-times iterated tt2- The following claim implies that if 
a G F realizes (Satur) for {Ck | k G N} then ni(a) realizes it for p. 

Claim: For any teNii holds that 

l3x/\Mx)} = lBz/\Ci(z)] . 

i<k i<k 

Clearly the left-hand side majorizes the right-hand side. For the opposite 
direction apply Corollary 13. II to get 7,/3i, ... ,/3fc G F such that 

l3x/\Mx)J = A 1^(7, AO! 

i < k i<k 

and define 

a := < 7 ,(/3i, <&,..., (/?fc, 7) ■■•) 

(the second 7 could be replaced by any element of F.) It is easy to see that the 
substitution z := a gives to the right-hand side in the Claim a value that equals 
to l3x^ k Mx)l 

q.e.d. 

5 The failure of the universal case 

In this section we show that Theorem 14.21 cannot be generally strengthened to 
sets of universal formulas. Take for L the language of Peano arithmetic together 
with the inequality sign < and with some function symbols for pairing and its 
projections, and having also a unary function symbol \x\ for the bit-length of 
number x. 
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In M. we shall identify numbers with the binary strings consisting of their 
bits. Let the sample space f2 be simply {0, 1}" for some non-standard n£M 
and let the family F consist of all functions on il computed by circuits with 
n inputs and arbitrarily many outputs but of the size bounded above by all 
terms 2™ 1/fc , for all k e N. In other words, these arc functions computed in 
sub-exponential non-uniform time. It is easy to see that F is compact: take for 

1/ k 

Fk the functions on Q computed by circuits of size bounded above by 2™ 

Let idn be the identity function on f2. Consider the following universal 
L-formulas: 

A k (x) := \x\ k < \id n \ AVy(\y\ ? x) . 

(The expression \x\ k is just an abbreviation for the term \x\ ■. . . • \x\, \x\ occurring 
fc-times.) 

The value of \idn\ is on all samples n. Take for x any constant function a 
outputting a fixed string of bit-length n x l k and of value 2" 1 . Then clearly 
l\a\ k < \ida\l= lg but also [Vj/(|y| ^ a) J = lg. This is because no function 
from F can output a string of length 2™ 1 This implies that the left-hand side 
of (Satur) for formulas Ak(x) has the truth value lg. 

On the other hand, assume that a makes all sentences \a\ h < \id^\ valid. 
Hence the sets UuQQ defined by 

ueU k iff |a(w)| < n 1 ^ 

have all counting measures infinitesimally close to 1. The sequence of Uk thus 
satisfies 

E/i 2 ■ ■ ■ 2 U k 

and 

1 - i^l < 1/k , for alii < k . 
\il\ 

Taking its non-standard extension {Ui}i<t and applying the Overspill analo- 
gously as before yields a non-standard s < t for which the counting measure of 
U s = ((\a\ s < \idn\)) is infinitesimally close to 1, i.e. [|o:| s < \idn\1 = 1b holds. 

But then the value of a on each sample from U s is at most 2" 1/s and so 
there is a (3 G F that outputs on each sample to e U s a string of bit-length 
a(uj) < 2™ 1/s . For such (3 however, l\(3\ ^ a\ = 0g. This argument proves the 
following statement. 

Theorem 5.1 There is a finite language L and an L- closed family F that is 
closed under definition by cases by open L-formulas, compact and such that 
K(F) has pairing, but for which there is a countable set of universal L(F)- 
formulas in one free variable x for which no element of K(F) realizes the satu- 
ration inequality (Satur). 
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6 A concluding remark 



In the abstract we have alluded to intended applications of forcing with random 
variables in proof complexity. To illustrate - in rather abstract terms - how open 
saturation can be useful consider the following situation. 

Let T be a theory in a countable language L and let ip be an L-definable 
3CNF propositional formula <p. In a typical example T may be an extension of 
a bounded arithmetic theory by an open diagram of some L-structure. The task 
would be to construct a model of T containing a truth assignment satisfying ip. 
That is, the model should satisfy a sentence of the form 

3x\/yA(x, y) 

where A(x, y) is an open formula formalizing that the assignment x satisfies the 
y-th 3-clause of ip. 

If such a model can be found with a satisfying \fyA(a, y), it often actually 
suffices to work further only with a substructure of the model generated by a. 
But in order for this substructure to satisfy \/yA(a, y) it is not necessary that 
the original model satisfies VyA(a, y); it suffices that a realizes in the model the 
open type consisting of countably many formulas 

A(x,t(x)) 

with t(x) ranging over all (countably many) terms with the only free variable x. 

Open saturation allows to simplify the task to construct such a model and 
to consider only how to realize in it finite subsets of the type. 
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